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Generalized Interference Alignment — Part I: 

Theoretical Framework 

Liangzhong Ruan, Member, IEEE, Vincent K.N. Lau, Eellow, IEEE, and Moe Z. Win, Eellow, IEEE 


Abstract —Interference alignment (lA) has attracted enormous 
research interest as it achieves optimal capacity scaling with 
respect to signal to noise ratio on interference networks. lA 
has also recently emerged as an effective tool in engineering 
interference for secrecy protection on wireless wiretap networks. 
However, despite the nnmerons works dedicated to lA, two of 
its fundamental issues, i.e., feasibility conditions and transceiver 
design, are not completely addressed in the literature. In this 
two part paper, a generalized interference alignment (GIA) 
techniqne is proposed to enhance the lA’s capability in secrecy 
protection. A theoretical framework is established to analyze 
the two fundamental issnes of GIA in Part I and then the 
performance of GIA in large-scale stochastic networks is char¬ 
acterized to Illustrate how GIA benefits secrecy protection in 
Part II. The theoretical framework for GIA adopts methodologies 
from algebraic geometry, determines the necessary and snfficient 
feasibility conditions of GIA, and generates a set of algorithms 
that can solve the GIA problem. This framework sets up a 
foundation for the development and implementation of GIA. 


I. Introduction 
A. Background and Survey 

Due to the broadcast nature of the wireless propagation 
medium, interference is a major factor that limits the per¬ 
formance of wireless communication networks. Conventional 
interference control schemes, most of which adopt the princi¬ 
ple of channel orthogonalization are in general non-capacity 
achieving lA Q reduces the effect of aggregated 

interference by aligning interference from multiple sources 
into lower-dimensional subspaces at receivers. It achieves the 
optimal capacity scaling with respect to signal to noise ratio 
(SNR) in a wide range of networks 0-0. On the other hand, 
in a wireless network that requires the secure exchange of 
conhdential messages, interference, which enables legitimate 
partners to impede the eavesdropping receivers (ERs), emerges 
as a potentially valuable resource for wireless network secrecy 
0^ ®- In order to impede the ERs without interfering with 
legitimate receivers (LRs), a few studies have adopted the lA 
scheme proposed in Q to promote wireless secrecy ©-HD- 
However, the scheme in 0 is based on inhnite-dimensional 
symbol extension, making it difficult to implement in practice. 

To avoid the inhnite-dimension issue, researchers have 
developed spatial-domain lA schemes, in which interference 
is coordinated and canceled via the hnite signal dimension 
provided by multiple antennas. Eor this scheme, there are two 
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fundamental issues: (1) When is lA (without symbol exten¬ 
sion) feasible; and (2) Given that lA is feasible, how to design 
an algorithm to hnd transceivers that cancel all interference? 
Eor the feasibility issue, the pioneering works characterize 
the lA feasibility conditions under some special conhgurations 
|[T2l-|[T^- In ITT) , flSl , a numerical test that checks lA fea¬ 
sibility is proposed. In the authors’ prior work p^ , we prove 
a sufficient lA feasibility condition for MIMO interference 
networks with a general conhguration. This results unifies and 
extends those in ig-ITg. Eor the transceiver design issue, 
there are two categories of algorithms: constructive ones and 
iterative ones. The constructive algorithms apply to networks 
with special conhgurations p0)-p2). The iterative algorithms 
p^-p9| apply to networks with general conhgurations, but 
they converge to local optimums. Table [I] and [n| in Section [n| 
summarize the contributions and limitations of the existing 
works on lA feasibility analysis and transceiver design. The 
incomplete theoretical foundation imposes a great challenge 
on the development of lA. 

Eurthermore, as will be discussed in detail in Part II, 
to promote the capability of lA in secrecy protection, it 
is desirable to introduce legitimate jammers (LJs) into the 
network and jointly coordinate the transmission policy of all 
legitimate partners to create stronger interference at the ERs 
without affecting the LRs. In this paper, this technique is 
referred to as GIA. To develop such a technique, the following 
challenges need to be addressed: 

• Determine the feasibility conditions of GIA: Eeasibility 
analysis of lA is challenging because lA constraints are 
sets of non-linear equations, for which no systematic 
tool exists to analyze the feasible region. In the authors’ 
prior work eg. by exploiting the connection between the 
feasibility of lA and the linear independence of the hrst 
order terms of lA constraints, an algebraic framework 
was established which gives a sufficient condition of lA 
feasibility. However, this framework is incomplete as it 
does not characterize necessary feasibility conditions. 

• Design GIA transceivers under general configuration: 
Eor networks with a general conhguration, existing lA 
transceiver design algorithms may not be able to hnd a 
solution even when lA is feasible. The lA transceiver 
design problem is usually formulated into an interference 
leakage minimization form | |23| , p4| or a rank mini¬ 
mization form j^. However, in both forms, the problem 
is non-convex, making it challenging to hnd solutions. 
Moreover, in a network with many nodes, the dimension 
of the transceiver matrices is large. Designing algorithms 
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to solve a non-convex, high-dimensional problem is dif¬ 
ficult. 


B. Contribution of This Work 

In this work, we will address the challenges listed above. 
We will consider MIMO wireless-tap network^ with LJs. By 
adopting tools from algebraic geometry | [3Tj , we establish a 
framework which shows the (almost sure) equivalence of the 
feasibility of the GIA transceiver design problem, the algebraic 
independence of GIA constraints, and the linear independence 
of the hrst order terms of GIA constraints. This framework 
enables us to propose and prove a necessary and sufficient 
condition for GIA to be feasible in MIMO networks with 
a general conhguration. By combining this condition with 
graph theory p2) , we generate several insights into the relation 
between network configuration and GIA feasibility. 

To address the challenge in GIA transceiver design, we 
exploit the equivalence between algebraic independence of 
GIA constraints and full rankness of their Jacobian matrix, 
and prove that when GIA is feasible, in a set of corresponding 
interference minimization problems, there is no performance 
gap between local and global optimums. This fact enables 
us to hnd solutions for the GIA transceiver design problem 
by adopting existing local search algorithms. The feasibility 
analysis and transceiver design for GIA covers those for lA 
as a special case. 


C. Organization 

Section formulates the GIA problem. Section III in¬ 
troduces the mathematical preliminaries. Section IV estab¬ 
lishes an algebraic framework that determines GIA feasibility 
conditions and design GIA algorithms. Section provides 
numerical tests on the convergence issue of the proposed GIA 
transceiver design algorithm. Finally, Section [Vl] gives the 
conclusion. 
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Fig. 1. Network configuration of wireless-tap networks with LJs. 


of a space. diag"(A,..., X) represents a block diagonal 
matrix with submatrices A,..., X on its n-th diagonal. For in- 

000000 


stance, diag ([2,1], [1, 2]) = 
diag°(A,..., X), and diag[TO 


210000 

001200 


■ diag(A,... 
(A) = diag(A,..., A) 


.X) = 


m times 

4) Algebraic geometry: For a field /C, }C{xi,... ,Xj) rep¬ 
resents the held of rational functions in variables xi,... ,Xj 
with coefficients drawn from K,. Notation (/i,..., f^) denotes 
the ideal generated by polynomials /i,..., /s; notation V(-) 
denotes vanishing set of an ideal; and notation Jx(/i, • ■ ■, /l) 
represents the Jacobian matrix of polynomials G 

/C(xi,..., xs) evaluated at point x G JC^. 


II. Problem Formulation 

In this section, the system model of wireless-tap networks is 
described, which is a generalization of interference networks, 
and then the GIA transceiver design problem is formulated. 


D. Notations 


1) General: a, a. A, and A represent scalar, vector, matrix, 
and set/space, respectively. N, Z, K and C denote the set 
of natural numbers, integers, real numbers, and complex 
numbers, respectively. 

2) Functions: n\m denotes that n divides m, and n mod m 
denotes n modulo m, n, m G Z. !{•} is the indicator function. 


is the Binomial coefficient with parameters n, to S N. 
|a| represents the absolute value of scalar a, and \A\ represents 
the cardinality of set A. 

3) Linear algebra: The operators (•)^, det(-), 

rank(-), || • ||f, trace(-), (•)^, Aff), and vec(-) denote trans¬ 
pose, Hermitian transpose, determinant, rank, Frobenius norm, 
trace, Moore-Penrose pseudo inverse, null space, and vec- 
torization of a matrix. span(A) and span({a}) denote the 
linear space spanned by the column vectors of A and the 
vectors in set {a}, respectively, dim(-) denotes the dimension 


* “wireless wiretap” is referred to as “wireless-tap” in this paper to 
emphasize the wireless nature of the propagation medium. 


A. System Model 

Consider a network consisting of K legitimate transmitter 
(LT)-LR pairs, J LJs and K ERs0 as illustrated in Fig. 
(Note that LTs and LJs are indexed from 1 to AT and from 
K+1 to K+J, respectively.) Suppose LT j (or LJ j, if j ? 
K), LR fc, and ER k are equipped with Mj, Nf\ and 
antennas, respectively. At each time slot, LT (or LJ) j sends 
dj independent symbols. LT k attempts to send conhdential 
messages to LR k, while ER k attempts to intercept these 
messages. LJ j transmits dummy data to generate interference. 

The received signals G at LR k and ER k are 

given by 

K 

^ Hgv,x,+z« 



Vk = (ui 


^In fact, as the proposed GIA technique does not require the channel state 
of the eavesdropping network, the ERs are not involved in GIA feasibility 
analysis. However, they remain in the system model to make the notation 
consistent with Pait II. 
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where K = K + J, G i G {l,e} are 

the channel matrices from LT (or LJ) j to LR k or ER k, 
whose entries are independent random variables drawn from 
continuous distributions; Xj G is the encoded information 
symbol at LT (or LJ) j; V,- G is the precoder at 

LT (or LJ) j; G i G {f, e} is the decoder 

at LR k or ER fc; and G t G {£,e} is the 

white Gaussian noise with zero mean and unit variance. The 
transmission power of LT (or LJ) j is given by 

Pj = E {trace(x^Vj^VjXj)} . (2) 


TABLE I 

Applicable Configurations of Existing Necessary and 
Sufficient IA Eeasibility Conditions 


Reference 

Network Configuration 


12 


if e N, dj, = 1, Vfc 


13 


K>3, dk = d, Nf'> = Mk= N, Vfc 


U 


iVsN, dk = d, d\NfKwdd\Mk, Vfc 


15 


K = 3, dk = d, = N, Mk= M, Vfc 

mi 

if e N, dk = d, = N, Mk= M, 

min{M, A^} > 2d, Vfc (extension of |13|) 

if e N; dk = d, or d\Mk, Vfc 

(extension of (Tl), |14|) 


Define the configuration of the legitimate network 

as X = 

Remark 2.1 (Applicability to Interference Networks): The 
wireless-tap network proposed above is a generalization of 
interference networks. Specifically, when there is no LJ, i.e., 
K = K, and the channel state of the eavesdropping links are 
zero matrices, i.e., nfj = 0, Vfc,j, the channel model Q is 
reduced to that of conventional MIMO interference networks. 
Hence, as further illustrated in Remark |2.2| the theoretical 
results obtained in this work apply to MIMO interference 
networks. □ 


B. GIA Transceiver Design with Flexible Alignment Set 

Classical IA requires canceling interference on all cross 
links. However, in large-scale networks this target may be 
infeasible and unnecessary. On one hand, the limited policy 
space in transceiver design may be insufficient to cancel 
interference on all cross links; on the other hand, some links 
may have very deep fading and hence there is no need to cancel 
interference on these links. Hence, to develop GIA strategies 
that fit large-scale networks, a more flexible approach must be 
adopted, in which the legitimate partners selectively cancel 
interference on a subset of cross links. This problem is 
formulated as follows: 

Problem 2.1 (GIA Transceiver Design): Design transceivers 
Vj}, fc G {1, ■. ■ ,K}, j G {1,... ,K} that satisfy the 
following constraints: 


rank((ui'yHiiVfc) = 4, 

rank(Vj) = dj^ 

and = 0, 


VfcG JT}, (3) 

yj e{K+l,...,K}, (4) 

V(fc,j)GA, (5) 


where A C = {{kj) ■ k G AT}, j G 

{!,... ,K},k f j} is the alignment set. It characterizes the 
set of cross links on which interference is to be canceled. □ 
Remark 2.2 (Connection between IA and GIA Problems): 
When there are no LJs and the alignment set includes all 


cross links, i.e., K = K, A = Aaih Problem 2.1 is converted 


to the classical IA problem on MIMO interference networks 
(without symbol extension). Since Problem |2.1| is a 
generalization of the classical IA problem, the feasibility 
conditions and algorithm design that are obtained in Section[rV| 
naturally apply to the IA problem. □ 

Table |I] and outline the contribution of existing works 
on IA (i.e., with K = K, A = Aa\i) feasibility analysis and 


TABLE II 

Applicable Configurations of Existing IA Algorithms 


Reference 




Type 

constnictive 

constructive 

constructive 

constructive 

iterative 


Network Configuration 


K = 3, dk=d, 
K = 3, dk=d, 
X g N, dfc = 1, 
K>2, dfc = 1, 


= Mk = N, Vfc 
= N, Mk = M, Vfc 
= 2, Vfc _ 

= Mk = K - I, Vfc 


general configuration 


transceiver design. Prom these tables, it can be seen that IA 
feasibility conditions are determined for special configurations, 
and constructive IA transceiver design algorithms are also 
only applicable to special cases. Although existing iterative IA 
transceiver design algorithms apply to general configurations, 
they may not converge to a global optimum. In other words, 
the outputs of iterative algorithms may not be solutions of the 
IA problem. In this paper, we will determine the GIA feasibil¬ 
ity conditions and develop algorithms that solve GIA problems 
for networks with general configuration and alignment sets. 

III. Preliminaries 

In this section, we will outline the mathematical approaches 
adopted in the existing theoretical works on IA and illustrate 
the remaining technical challenges. Then the notion of al¬ 
gebraic independence will be introduced, which is the most 
important mathematical concept adopted in this work. 

A. Challenge in IA Feasibility Analysis 

There is an inherent connection between the feasibility of 
a set of polynomial equations and algebraic geometry p4) , as 
illustrated in Pig. As a result, several prior works on IA 
feasibility analysis convert the IA problem into a polynomial 
form and then adopt tools from algebraic geometry. In fact. 
Problem |2.1| can be converted to the following polynomial 
formf] 

Problem 3.1 (Polynomial Form of GIA Transceiver De¬ 
sign): Design Life G ^-dk)xdk^ -y . g £(Mj-dj)xdj 

that: 

/fc,p,({Ufc,V,}) 

^ ii«(p)Hg(4 + l : iVf ,9) +Hg(p,4 + 1 : 

+fi»(p)Hg(4 + l : Vf ,4 + 1 : M,)4(9) (6) 

= -hkj{p,q), 

^This statement will be proved formally in Theorem 4.1 
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Solutions of the 
equation set: 

f xy — 1 = 0 
[ x^ + — 4 = 0 


Algebra 


The intersection 
of two curves 


V((/l,/2)), 

where: 


f2(x,y) ■■ 


■xy-l, 


Algebraic 

Geometry 



Fig. 2. An illustration of the correspondence of Algebra, Geometry and 
Algebraic geometry, w here V({/i, / 2 )) denotes the vanishing set of the ideal 
generated by {/i,/ 2 ) (33| Def. 1, Section 1.4]. 


where k,j £ A, p .,dk}, g S {1,... ,dj}, Ufc(g), and 

v^ (g) represent the g-th column of Ufe and Vj, respectively. 
hkj {p, g) is the element in the p-th row and g-th column 
of afj, and llfj(p : p',q : q') represents the submatrix 
intersected by p to p'-th rows and g to g'-th columns of 


Challenge of Nonlinearity 

In the polynomials fkjpq defined above, there are second 
order terms, i.e., + 1 : N^^\dj+1 : 

Mj)'Vj{q). The presence of these second order terms 
makes it difficult to analyze the feasible region of Prob¬ 
lem o This is because there are very few systematic 
tools that address the solvability issue of a set of nonlinear 
polynomial equations. 


B. Challenge in lA Transceiver Design 

Existing lA transceiver design algorithms can be classi¬ 
fied into two categories: constructive algorithms and iterative 
algorithms. The constructive algorithms design transceivers 
according to some closed-form functions of the channel states. 
However, as illustrated in Table these algorithms only apply 
to limited configurations. 

Iterative algorithms are applicable to networks with a gen¬ 
eral configuration. The most influential iterative algorithm was 
proposed in and \2^ ^This algorithm searches for the lA 
solution by exploiting the uplink and downlink reciprocity and 
alternatively updates precoders and decoders in the following 
problem. 

Problem 3.2 (Interference Minimization): 


minimke ^ ^ ^trace Hfc,V,) 

k=lj=l,^k ^ 

(7) 

subject to VfVj = I, Vfc,j. (8) 


Although widely adopted in the literature, the alternative 
minimization algorithm converges to a local optimum. In other 
words, it may not be able to cancel all interference even in 


^There are some differences between the algorithms proposed in |23| and 
j24|. However, the structure and the idea of these two algorithms are similar. 


lA feasible regions]^ The convergence issue is challenging 
because of the non-convexity challenge elaborated below. 

Challenge of Non-convexity 

(1) The objective function (|7| is not a convex function 

'—^ 

of the optimization variables Vj, ; 

(2) The policy space defined by (§ is non-convex. 


C. Introduction to Algebraic Independence 

To overcome the nonlinearity and non-convexity challenges 
in the lA problem, a theoretical framework will be developed 
based on one of the key notions in algebraic geometry, 
i.e., algebraic independence. In this section, the definition 
of algebraic independence will be introduced and intuitions 
associated with the notion will be highlighted. 

First recall linear independence. Let /C be a field, then the 
standard definition of linear independence is given by: 

Definition 1 (Linear Independence (Form I)): Vectors a; € 
K,^, I G {1,..., L} are linearly independent iff 7^ 

0, v[/ci,...,fcL] 7^ o,e/c^. □ 

In fact. Definition [T] can be transformed to the following 
equivalent form, which involves linear functions: 

Definition 2 (Linear Independence (From II)): Define linear 
functions /; = X]s=i ^i{s)xs, ? G {1,..., L}, where ai{s) is 
the s-th element of a;. Coefficient vectors {a;} are linearly 
independent iff. G{fi ,..., f^) ^ 0, V non-zero linear function 
G. □ 

With Definition we are ready to introduce algebraic in¬ 
dependence. In fact, one just need to replace “linear function” 
by “polynomial” in Definition to arrive at the definition for 
algebraic independence: 

Definition 3 (Algebraic Independence): Polynomials fi € 
IC(xi,... ,xs), I £ L}, are algebraically indepen¬ 
dent iff G(/i,...,/l) ^ 0, V non-zero polynomial G £ 

/C(zi,... ,z_k). □ 

Remark 3.1 (Linear and Algebraic Independence): The un¬ 
derlined parts in Definition and highlight that algebraic 
independence is an extension of linear independence. In the 
light of this information, it is reasonable to guess the properties 
of algebraic independence based on those of linear indepen¬ 
dence. For instance, if a statement holds conditional on linear 
independence, it is possible that a similar statement also holds 
conditional on algebraic independence. As will be illustrated 
in Remark [TT| this intuition does help to construct a unified 
algebraic framework for both GIA feasibility analysis and 

algorithm design. □ 

IV. Feasibility Conditions and Transceiver Design 

In this section, the main theoretical results on the GIA feasi¬ 
bility analysis and transceiver design are proposed and proved. 
First, an algebraic framework is established, which shows the 

^That having been said, from the extensive numerical tests in Section Ivl 
we tend to believe that the algorithm proposed in |23| converges to a global 
optimum when lA is feasible. However, this conjecture is not proved in the 
literature. 
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—^ Propositions estalishcd in the authors’ prior work [19] 

—^ Propositions estalishcd in this work 

Fig. 3. Outline of the algebraic framework for the GIA problem. 


Hall is described 


in Fig. 1^ 


£(dkdj)x{dk(Nl^^-dk)) JjV 

kj 

fined by 


where the submatrices 11)^^ G 

£{dkdj)x(dj{Mj-dj)) 


^1 = 


diag[4] 


^ 1 j 1); h[^j (dk~\- 2,1), 

hkj 0fe+l, 2), hkj (dfe+2, 2), 


hkM'\2) 


V hkjidk+1, dj),hkj{dk+2, dj},- ■ ■,hkj{Nf\dj) j 


(9) 




diag[(ij] (/ifcj(l, dj+l), fifcj(l, dj+2), ■ ■ •, hkj{l,Mj)) 
diagidjj (fifci(2, dj+l), hkj(^, dj+2), ■ ■ •, 


( 10 ) 


diag[fij] (hkjidk^ d^d-l), h^jidk^ dj~G2j^‘ * ■, 

where hkj {p, q) denotes the element in the p-th row and g-th 
column of nfj, k ^ j,k G {1,..., K},j G {!,..., K}. Note 
that the coefficient vectors of the first order terms in {fkjpq} 
are linearly independent iff. Haii is full row-rank. 

The following three theorems construct the algebraic frame¬ 
work for GIA feasibility analysis and algorithm design. 

Theorem 4.1 (Equivalence of Feasibility and Algebraic In¬ 
dependence): Under a network configuration x, Problem |2.1| 
has solutions almost surelj^ iff. the polynomials {fkjpq} 

®In this paper, “almost surely” means “with probability 1.” 


defined in (|^ are algebraically independent. The solution of 
Problem |2.1 1 can be obtained by first solving Problem 3.1 and 


then constructing transceivers V^j via ([TT]l: 


uf ^ = 


Idfc xdfc 

Ufe 


Vj- = 


xdj 

V, 


( 11 ) 


(almost sure) equivalence of 1) feasibility of Problem 2.1 2) 
algebraic independence of {fkjpq} defined in (|^, 3) linear 
independence of the coefficient vectors of the first order terms 
in {fkjpq}, and 4) full rankness of the Jacobian matrix of 
{fkjpq}- Based on this framework, a necessary and sufficient 
feasibility condition of the GIA problem and design algorithms 
will be given to solve the GIA problem. 

A. Mathematical Framework 

We will first define the coefficient matrix of the first order 
terms of GIA constraints, then list the three theorems that 
construct the algebraic framework outlined in Fig. and 
finally elaborate the intuition of these theorems by showing 
their counterparts in linear algebra. 

Define Haii as the matrix aggregated by the coefficient 
vectors of the first order terms in {fkjpq}- The structure of 


Proof: Please refer to Appendix for the proof. □ 
Theorem 4.2 (Equivalence of Algebraic Independence and 
Linear Independence): Under a network configuration x, 
trix Hall (defined in Fig. is either full row-rank almost 
surely or always row-rank deficient. In the first case, the poly¬ 
nomials {fkjpq} defined in (|^ are almost surely algebraically 
independent. Otherwise, {fkjpq} are algebraically dependent. 

Proof: Please refer to Appendix for the proof. □ 
Theorem 4.3 (Equivalence of Algebraic Independence and 
Nonsingularity of Jacobian Matrix): The polynomials {fkjpq} 
defined in ^ are algebraically independent iff the Jacobian 
matrix Jx{{fkjpq}) is full row-rank on a dense and open sub¬ 
set of where V = dk{,Nf"‘ - dk)+Y}f=i dj{Mj - 

dj)- 

Proof: Please refer to Appendix for the proof. □ 
Remark 4.1 (Intuition from Linear Independence): To inter¬ 
pret the algebraic framework outlined in Fig. consider a set 
of linear functions: 

s 

fi(xi,... ,xs) = '^ai(s)xs = WX, I G {!,..., L}, (12) 


where coefficient vector a; = [a/(l),..., a;(5')] G 
variable vector x = [xi,..., xg]"’’ G C'^. Define A = 


and 
ai 


ai 


From linear algebra, the following proposition holds: 

Proposition 4.1 (Equivalence of Linear Independence and 
Feasibility): Consider a vector b = [bi,... whose 

elements are independent random variables drawn from con¬ 
tinuous distribution. Then linear equation set fi = bi, I G 
{!,..., L}, i.e.. Ax = b has solutions iff. vectors ai,..., a^, 
are linearly independent. 

Furthermore, for any vector x S C'®, the Jacobian matrix is 





. ^ 

dx\ 

dxs 

dfL . 

. ^ 

- dxi 

dxs 


= A. 


(13) 


Hence, the following proposition is also true: 

Proposition 4.2 (Equivalence of Linear Independence and 
Nonsingularity of Jacobian Matrix): The coefficient vectors 
of fi,..., fk are linearly independent iff. the Jacobian matrix 
Jx(/i, • ■ •, /l) is full row-rank for any x G . 


By comparing Proposition 4.1 and 4.2 with Theorem 4.1 


and |4.3[ it can be seen that linear independence and algebraic 
independence play a similar role in these statements. This 
fact fits the insight illustrated in Remark o Actually, in 
the authors’ previous work Lem. 3.1], it was shown that 
if the coefficient vectors of the first order terms of a set of 
polynomials are linearly independent, then these polynomials 
are algebraically independent. The inverse proposition of 119 
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K + K blocks 


Position of the Submatrices 

s. 

If X=U, this subma- H?, If X—V, thin submatrix 

trix appears in the k- “<- ^- ^appears in the 

th block from left. th block from left. 

This submatrix appears in Xg{U,V} 

tlie 6 k€{l,...,K], 

_ .4)-til block from top. _ jg {1,... ,K},k^j ^ 


Fig. 4. The matrix scattered by the coefficient vectors of the linear terms in the polynomial form of the GIA constraints. For clear representation, A is set to 
be equal to .4aii in the figure. When A C .4^11, part of the rows will not appear. The zero matrices which appear on the same block row with Hjk and 

have df^dj rows. The zero matrices which appear on the same block column with or have ^ —di^) and dj (Mj — dj) columns, respectively. 


Lem. 3.1] is not true for general polynomials. Yet, in this 
paper, by exploiting the special structure of the polynomials 
defined in the inverse proposition for GIA problems has 
been proved and hence Theorem 4.2 is obtained. □ 


B. Feasibility Conditions 


Solution to the Challenge of Nonlinearity 

Based on the algebraic framework established in Sec¬ 
tion |IV-A| we have the following theorem which deter¬ 
mines the feasibility condition of GIA. 

Theorem 4.4 (Necessary and Sufficient Feasibility Condi¬ 
tion): Problem |2.1| has solutions almost surely iff. matrix 
Hall in Fig. is full row-rank. 

Proof: This theorem is an immediate consequence of 
Theorem 14.11 and 14.21 □ 


With Theorem 4.4 there are three propositions illustrating 
the general trends on GIA feasibility. 

Corollary 4.1 (Configuration and Alignment Set Dominate 
GIA Feasibility): Under given network configuration x 
alignment set A, Problem 2.1 is either always infeasible or 
feasible almost surely. 

Proof: This corollary is an immediate consequence of 
Theorem 14.41 and Lemma lA.31 □ 

Corollary 4.2 (Scalability of GIA Feasibility): Under given 
alignment set A, scaling the legitimate network configuration 
does not affect the GIA feasibility state, i.e., networks with 
configuration x = {{cMi,... \ 


(cdi,... ,cdj^)}, Vc S N are either all GIA feasible or all 
GIA infeasible. 


Proof: The proof is similar to that of 119 Cor. 3.2]. The 
details are omitted to avoid redundancy. □ 

Remark 4.2 (Contributions of Corollary \4.1\ \4.2\ : Theo¬ 
rem 4.4 gives a complete characterization of the feasibility 


condition of GIA problems. However, the feasibility condi¬ 
tion in Theorem |4.4| is complicated as it relates to network 
configuration x, alignment set A . as well as the instantaneous 


channel state {Hg}- Corollary |4.1 1 simplifies this condition 
by showing that with probability 1, the feasible state is deter¬ 
mined by configuration x and alignment set A. Corollary 4.2 
further simplifies this condition by showing that networks with 
configurations different by a factor share the same feasible 
state. 

One application of the propositions is an efficient method to 
check GIA feasibility. To determine if a set of networks with 
configuration x = {{cMi,... ,cMy^), (cN[^\ ... 

(cdi,... ,cdf^)}, Vc € N is GIA feasible or not: set c = 1, 
randomly generate one channel state, and check if Haii is full 
row-rank or not. □ 

Corollary 4.3 (Necessary GIA Feasibility Condition): A 
network with configuration x and alignment set A is GIA 
feasible only if 

^ d,(M,-d,)+ Y. MNi'^-dk)> 

j-{k,j)eABub k:{k,j)eAsuh 

Y dkdj, VAubCyf. (14) 

(fc.jlGAsub 
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Proof: Denote Hgub as the submatrix of Haii that 
corresponds to Aub- Hgub has J2{k,j)eA^^b^kdj rows and 

- dj) + Ek-.ik, 3 )eA.^Jk{NP - dk) non¬ 
zero columns. Hence, when does not hold for a certain 
yfsub, the corresponding Hgub is row-rank dehcient and so 
is Hall- From Theorem |4.4| the network is infeasible. This 
completes the proof. □ 

Remark 4.3 (Properness and Feasibility): In the pioneering 
work on lA feasibility analysis the authors conjecture 
that a MIMO interference network is lA feasible only if the 
network is proper; i.e., the number of variables in transceiver 
design is no more than the number of lA constraints. This 
conjecture was later conhrmed by HD and fT?) . Corollary |4. 3 1 
shows that properness is still a necessary feasibility condition 
for GIA problems. □ 

In the following, two corollaries are given which reveal 
simple insights into how legitimate network conhguration x 
and alignment set A determine the GIA feasibility. 

Corollary 4.4 (Symmetric Configuration): When 1) net¬ 
work conhguration x is symmetric, i.e., dk = d, Mk = M, 
and = N, Wk G K}, with min{M, N} > 2d; 

2) alignment set between the LRs and LTs is L-regular, i.e., 
Ef=imk,j) e A} = ELiKikj) e A) = L, ykj e 
Ff}; and 3) each LJ chooses the proper number of 

LRs to coordinate with, i.e., ^i{k,j) £ A) < 

has solutions almost surely 

iff. inequality ([T5ll is true, where 


Vj S ..., K}, Problem 


2.1 


Mj —d 




M + N - {L + 2)d>0. (15) 

Proof: Please refer to Appendix for the proof. □ 
Corollary 4.5 (“Divisible" Configuration): When the net¬ 
work conhguration x satishes 1) dk = d, Vk £ {1,... ,K} 
and 2) d\N'f \ \/k G K} or d\Mk, Vfc € K}, 

Problem |2.1 1 has solutions almost surely iff. inequality ( [T6] l is 
satished, where 

^ ^ (ivf-d)>d|Aub|, ( 16 ) 

j:(fej')6Aub k:{k,j)eAsub 


V-Asub C A. 

Proof: Please refer to Appendix for the proof. □ 
Remark 4.4 (Backward Compatibility to Existing Works): 
If one specify the GIA problem to the classical lA p robl em, 
i.e., sets K = K and A = Asdi, then Corollary 


4.4 


and 


4.5 


are reduced to 119 Cor. 3.3] and Cor. 3.4], respectively. 
Further noting that 119 Cor. 3.3] and |[T^ Cor. 3.4] extend 
the feasibility conditions proved in fT?) and HD, respectively. 
Corollary |4.4| and |4.5| are consistent with prior theoretical 
results on lA feasibility and extend these results to the GIA 
case. □ 


C. GIA Transceiver Design 

As illustrated in Section III-B| lA transceiver design is 
challenging because neither the policy space nor the objective 
function of the interference minimization problem is convex. 
Fig. 1^ gives an intuitive illustration of how this challenge will 
be overcome. In the hrst step, transform the problem to an 
equivalent one with convex policy space. In the second step. 






Step 1: Traiistbrm to an Step 2: Prove that there Ls 

equivalent problem with no performance gap between 



Fig. 5. An intuitive illustration of how the algebraic framework established 
in this work enables us to find the global optimum of the interference 
minimization problem. 


prove that there is no performance gap between the local and 
global optimums. Hence, despite the fact that the objective 
function is non-convex, the problem can be solved by various 
local search algorithms. 


Solution to the Challenge of Non-convexity (Step 1) 

In Problem EH the policy space is given by 

, which is 

a convex set. Hence, the hrst step is achieved by 
Theorem 14.11 


Then, transform Problem 3.1 to the following optimization 
problem (Problem |4.1[ ). Note that Probl em |3.1| is solved 
iff. there exists a solution in Problem 14.1 1 that satishes 
F({gkjp,(lJlV*)})=0. 

Problem 4.1 (Optimization Form of GIA Problem): 


minimize 




(17) 


where Pkjpq — fkjpq hkj{p^ q)., fkjpq ts dehned in (j^, 
ik,j) G A, p G dfc}, q G d^}, and F" is a 

nonnegative, convex and continuously differentiable function. 
F{{gkjpq(tJk,'^j)}) = 0 iff. Qkjpq = 0, yk,j,p,q. □ 


Solution to the Challenge of Non-convexity (Step 2) 

The following theorem achieves the second step in Fig. 


by exploiting Theorem 4.3 


Theorem 4.5 (No Gap between Local and Global Opti¬ 
mums): When the polynomial form of the GIA problem, 
i.e.. Problem o is feasible, in Problem |4.1| every local 
optimum is globally optimal. 

Proof: Please refer to Appendix for the proof. □ 


Remark 4.5 (The Role of Nonsingular Jacobian Matrix): 
The full row-rankness of the Jacobian matrix yy {{jkjpq}) 
plays a key role in the proof of Theorem |4.5| To see how it 
works, consider a polynomial map G : —>■ C^. At point 

xo G C^, 

G(xo-f Ax) = G(xo)+Jxo(G)Ax + (9(||Ax||2). (18) 

Consider a neighborhood of Xq with ||Ax|| <C 1 and suppose 
the Jacobian matrix Jxo(G) is full row rank. In this case. 





















Fig. 6. Outline of GIA transceiver design algorithms based on Theorem|4.5| 


the third term on the right-hand-side of ( [T8| l can be ignored 
compared to the second term, and AG = G(xo + Ax) — 
G(xo) = Jxo(G)Ax can be any vector in the neighborhood 
of 0. 

Cascade G with a convex function F : ^ K, and 

suppose Xq is a local optimum of F(G(x)). Then from the 
definition of local optimum and the property of AG just 
obtained, F(G(xo) + AG) > F(G(xo)) for any vector AG 
in the neighbourhood of 0. This implies yg = G(xo) is a 
local optimum of F. Since F is convex, F{yo) must also be 
a global optimum of F and therefore Xg is a global optimum 
of i^(G(x)). 


For Theorem |4.5[ there is a weaker condition on the 
nonsingularity of the Jacobian matrix, i.e., full row-rank on 
a dense open subset. Yet, by imposing a stronger condition 
on the form of F, i.e., being continuously differentiable, the 
proof can be completed. □ 

Remark 4.6 (Theoretical Basis for GIA Transceiver De¬ 
sign): As illustrated in Fig. based on Theorem 4.5 


generate a set of algorithms that solve the GIA transceiver 
design problem. Moreover, the freedom in designing the 
specific form of F and choosing local search algorithms 
can be exploited to improve algorithm performances, such as 
message overhead, convergence speed and throughput. Hence, 
Theorem 4.5 sets up a theoretical basis to design and improve 
GIA transceiver design algorithms. □ 

Remark 4.7 (Consistency with Existing Theoretical Result): 
As illustrated in p5| , lA transceiver design is highly chal¬ 
lenging because “it is impossible to propose an algorithm that 
converges to an aligned solution in polynomial time for each 
system configuration and for any set of channel matrices.” On 
the other hand, the authors of p5) also predicted that “there 
might still exist a polynomial time algorithm that can solve the 
problem ... with high probability (e.g., for almost all channel 
coefficients).” Noting that the polynomial form of the GIA 
transceiver design problem, i.e.. Problem 3.1 is equivalent to 
the original GIA transceiver design problem, i.e.. Problem |2.1| 
for almost all channel coefficients, the algorithms outlined 
in Fig. 1^ solve the original GIA transceiver design problem 
almost surely. In this sense, this result confirms the prediction 


made in | |35| . □ 

As an illustration, one specific algorithm will be prese nted 
to achieve GIA. Let Fjjxi}) = then Problem 

can be rewritten as the follows: 

Problem 4.2 (Reformed Interference Minimization): 


4.1 


subject to Eq. 0 


minimize 

V,.Ufc 


2 

J IIF 


(19) 


□ 


The following algorithm solves Problem 4.2 
Algorithm 1 (GIA Transceiver Design): 


• Step 1 Initialization : Randomly generate V^, j G 

• Step 2 Minimize interference leakage at the receiver 
side: At LR fc, update U^.: 


Ufe = 



( 20 ) 


where 

Xfc = [Xfcjj,..., {ji,... ,jt} = {j ■ {k,j) G 

A},'Xg{A,B}, 

Akj = Hfej (dfc-l-l : Nj, \ 1 : dj) + (dfe+l : Nj. ^, dj-\- 
1 : Mj)'Vj, and 

= Hfcj(l : dk, 1 : dj) -f Hfcj(l : dk, dj-\-l ■ MjfVj. 

• Step 3 Minimize interference leakage at the transmit¬ 
ter side: At LT (LJ) j, update Yj-. 

V, = -C#D„ (21) 


where 


Xj = 



, {ki,...,kR} 


{k : (fc, j) e -4}, X G 


p^kRj_ 

{C,D}, 

Ckj = Hfcj(l : dk,dj-\-l ■ Mj) -f -f 1 : 

Nl^\dj-\-l : Mj), and 

Dfc, = Hfc,(l : 4,1 : 4) + ijfUkj{dk + l : vf, 1 : 

) ■ _ _ 

• Repeat Step 2 and 3 until Vj and Ufc converge. Substitute 

in O and obtain }. □ 

Corollary 4.6 (Convergence of Algorithm^: Algorithm [T] 
always converees. Moreover, when lA is feasible, the ou tput 
of Algorithmfu i.e., {V*, }, is a solution of Problem [ 2 . l| 

almost surely. 

Proof: Please refer to Append ix [G| for the proof. □ 
Remark 4.8 (Execute Algorithm U\Distributively): Similar 
to the classical iterative lA algorithm p^ , p6| . Algorithm [T] 
can be executed distributively. To achieve this, after Step 2, 
LR k needs to send the updated Ufc to LTs (or LJs) with index 
j : {k,j) G A, and after Step 3, LT (or LJ) j needs to send 

the updated Vj to LRs with index k : (k,j) G A. □ 


V. Numerical Results 

In this section, we will numerically test the convergence 
properties of the proposed algorithm, i.e.. Algorithm [T] and the 
classical iterative lA algorithm proposed in |j2^. Please refer 
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to Part II for the numerical results on how GIA techniques 
enhance secrecy protection. 

Consider classical interference networks, i.e., networks with 
K = K, A = Aa,n- To verify if the IA algorithms can always 
hnd a solution in lA feasible scenarios, the following test is 
adopted. 

Test 1 (Convergence Test on Random Interference Net¬ 
works): Randomly select conhguration within the se|^ 

Kg {3,4,5}, 4 G 1,2,3, 4<Mfe,Kf)<15, Vfc, 


then randomly generate channel state following in¬ 

dependent complex Gaussian distribution. First check if the 
network is lA feasible by testing full row-rankness of matrix 
Hall (dehned in Fig. [^. If the network is lA feasible, perform 
the algorithm to be tested on this network. Denote the output 
transceivers after t rounds of iteration by {Vf;(f),U^^^(f)}. 
{Vfc(O),(0)1 are the initial guesses of the transceivers. 
Dehne the normalized power of interference (dB) after t 
rounds of iteration as 


I{t) = lOlogio 




(uf(f))HHgv, 




|(ui'^(0))HHgv,(0)| 


. ( 22 ) 


If the normalized power of interference can be reduced below 
—60 dB after some t, the algorithm passes the test. Otherwise, 
if the algorithm converges to a point with I{t) > —60, it fails 
the test. □ 

Test was performed for 10® times on both Algorithm 
and the classical iterative lA algorithm. In all the lA feasible 
scenarios (about 6.6 x 10 ® cases), both algorithms pass the 
test. This result verihes the claim of Corollary |4.6| 

To demonstrate how network conhguration affects the con¬ 
vergence properties of the proposed algorithm and classical lA 
algorithm, consider three similar networks 

• Configuration 1 (Feasible Symmetric Network): x = 
{( 6 , 6 , 6 ), ( 6 , 6 , 6 ), (3,3,3)}; 

• Configuration 2 (Feasible Asymmetric Network): x = 
{(5,5,5), (6,6,9), (3,3,3)}; 

• Configuration 3 (Infeasible Network): x = 
{(5,5,5), (5,7,9), (3,3,3)}. 

Fig. 0 illustrates the normalized power of interference I{t) 
as a function of rounds of iteration t under the proposed and 
classical lA algorithms in the three network configurations. In 
the two lA feasible networks, both algorithms converges sub- 
linearly, with the proposed algorithm converging 2dB and 4dB 
faster in the symmetric and asymmetric cases respectively. In 
the lA infeasible network, under the classical lA algorithm, 
I{f) converges to —21dB, whereas the proposed algorithm 
reduces I{t) to —28dB after 100 rounds of iteration (and 
converges to —30dB after 400 rounds of iteration). 


VI. Summary 

In Part I, we have proposed a GIA approach to further 
improve the lA’s capability in secrecy enhancement. As illus¬ 
trated in Fig. we have established an algebraic framework 

^The sizes of the networks are restricted so as to maintain manageable 
computation load. 



Fig. 7. Normalized power of interference as a function of rounds of iteration 
in different network configuration. For fair compaiison, we have scaled the 
output transceivers of both algorithms so that trace(V}^Vj,) and 

trace((u(}^)^u(}^) remain constants. 


that reveals the (almost sure) equivalence of 1 ) feasibility of 
GIA, 2) algebraic independence of GIA constraints, 3) linear 
independence of the coefficient vectors of the first order terms 
in GIA constraints, and 4) full rankness of the Jacobian matrix 
of GIA constraints. This framework allows us to address the 
two fundamental issues of GIA, i.e., feasibility conditions and 
transceiver design and hence sets up a foundation for the 
development and implementation of GIA (and lA, as a special 
case) techniques. 


Appendix A 
Proof of Theorem HTT] 


To prove the “if’ side, first prove the following lemma. 

Lemma A.l (Algebraic Independence Leads to Solutions): 
{ci,...,cl} G are independent random variables drawn 
from continuous distribution. Then if polynomials fi G 
C{xi,X2 ,. ■ ■, xs), I G {1,..., L} are algebraically indepen¬ 
dent, equation set // = ci, I G {1,..., L} has solutions almost 
surely. Otherwise, the equation set has no solution almost 
surely. 


Proof: The first half of the lemma is proved in 119 Lem. 
3.2]. Hence, the focus is on the second half of the lemma. 

Denote F : as the polynomial map defined 

by {/;}. Since /; are algebraically dependent, there exists a 
non-zero polynomial g such that p(/i,...,/l) = 0. Then 
for any point [ci,...,cl] G F{C^), p(ci,...,cl) = 0. 
On the other hand, since p is a non-zero polynomial, and 
{ci, ... ,cl} G are independent random variables drawn 
from continuous distribution, g{ci, ..., c^) 7 ^ 0 almost surely. 
Hence, [ci, ..., cl] ^ F{C^) almost surely. □ 

Now turn to the main flow of the proof of the “if’ side. From 
Lemma |A.1| when {fkjpq} are algebraically independent. 
Problem |3.1 1 has solutions almost surely. Then from (|^, the 
solution {U}^\ Vj} constructed by o satisfies Further 
noting that 

• {Ufc, Vj} are functions of the channel state of the cross 
links j}, and are hence independent of the 
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channel state of the direct links and 

• rank(U^^^) = rank(Vfc) = dk, 
we have that { 11 ^, V^j constructed by o satisfy ([^ and Q 
almost surely. Hence, in this case, Problem 2.1 has solutions 
almost surely. 

The “only if’ side will be proved by verifying its converse¬ 
negative proposition; 

Proposition A.l: When {fkjpq} are algebraically depen¬ 


dent, Problem 2.1 has no solution almost surely. 

To prove this proposition, first prove following lemmas. 

Lemma A.l (Algebraic Independence of Random Polynomi¬ 
als): The coefficients of polynomials // G C(xi,X 2 , ■ ■ ■ ,xs), 
I G { 1 ,..., L} are random variables drawn from continuous 
distribution. Then polynomials {/;} are either always alge¬ 
braically dependent or algebraically independent almost surely. 

Proof: {fi} are algebraically dependent iff there exists a 
non-zero polynomial g G C{yi,y 2 , ... ,yL) such that 


= 0 . 


(23) 


Without loss of generality, suppose g has N terms, whose 
coefficients are given by {ci,..., cjv}; then ( | 2 ^ can be 
rewritten as a set of linear equations: 


Fc = 0. 


(24) 


where c = [ci,..., CAr]"'’, F G S is the number 

of terms in p(/i,.-.,/l) after combining like terms. For 
instance, suppose /i = oi -f biXi, /2 = 02 - 1 - b 2 X 2 and 
g = ciyi -I- 022/2 -f C32/12/2; then 

9U1J2) = [ai,a2,aia2]c-|-[61,0, 6ia2]cxi-I- 

[0, 62 , aib2]cx2 + [0,0, bib2\cxiX2. (25) 
Hence, (|24|) is given by 


Oi 

61 

0 

0 


02 

0 

^2 

0 


0102 

61O2 

0162 

6162 





O' 


Cl 


0 


C2 

— 

0 


A3. 


0 


(26) 


Note that ( |24l l has non-zero solutions iff. N{¥) {0}, i.e., 

F is column-rank deficient. From Lemma pk.3| Eq. ( |24| ) either 
always has no non-zero solutions or has non-zero solutions 
almost surely. This completes the proof. □ 

Lemma A.3 (Rank of a Random Matrix): Suppose the en¬ 
tries of a matrix F £ either 0 or random variables 

drawn from continuous distribution. Then F is either always 
column-rank deficient or full column-rank almost surely. 

Proof: If M < F is always column-rank deficient. 
Otherwise, denote all the N x N submatrices in F by 

Fd}, where D = 

rank iff. the determinant of at least one F^, d G {1,..., D} 
is not zero. 

From the Leibniz formula |36 6.1.1], the determinant F^ is 


then F is full column- 


given by a polynomial of the entries in F^^. If this polynomial 
is a zero polynomial, the determinant of F^ is always 0 . 
Otherwise, noting that the entries of F^; are drawn from 
continuous distribution, the value of this polynomial is non¬ 
zero almost surely. This completes the proof. □ 


Now turn to the main flow of the proof of P ropo sition |A.1| 
Consider a solution Problem b l| From (|^, 

we have that rank(U)j .) = dk and rank(Vp = dj, 'dk,j. 

Hence, every (or Vp has at least dk (or dj) linearly in¬ 

dependent row vectors. Denote the submatrices aggregated by 
these linearly independent rows by (or v[,^^). Transform 
Ufc,V, as follows; 



and let IJfc and Vj be the nonconstant parts in UJ. and V' , 
respectively. Then, {Uj.,Vj} satisfies a set of polynomial 
equations in the same form as in which the position 
of in {Upvp only affects the indices of the 

coefficients. For example, suppose are given by 

^ (t) 

the last dk x dk and dj x dj submatrices in and 
respectively; then 0 can be rewritten as 

fk,p, ^ fiH(p)Hg(l:ivf-4,M,-p+g) 

+Hg(wf-4+P, 1 :M,-dpvPg) 

+fiH(p)Hg(l : iVf-4,1 : M,-d,)v,{q) 

= -hkjiN^^^-dk+p,Mj-dj-\-q), (28) 


which is the same as 
coefficients. 


0 , except for the indices of the 


Since all entries the of channel state matrices nfj are inde¬ 
pendent random variables drawn from continuous distribution, 
we have that if Problem [33 has no solution almost surely, 
for every possible position of the correspond¬ 

ing equation set also has no solution almost surely. Hence, 
Problem 2.1 has no solution almost surely. 


Appendix B 
Proof of Theorem I4.2I 

The proof of the first statement in Theorem |4.2| is given by 
Lemma IA.3I 

If matrix Han is full row-rank almost surely, from 119 
Lem. 3.1], polynomials {fkjpq} are algebraically independent 
almost surely. Hence, the focus is on the other case. 

The size of matrix Haii is C x V, where C = 


{k,j)€A 


jk—1^ 


and V 


~ Y}k=l ^ki-^k ^ + 

dj(Mj—dj). If matrix Haii is always row-rank deficient, 
there are two possibilities: 

• When C > V: Denote V as the set of all entries in 'Uj, 
and Vj, k G {l,...,iT}, j G [1,... ,K}. From pp 
Cor. 5.7], the dimension of the held V] is V. On the 
other hand, the number of the polynomials in {/fcjpq}, 
i.e., C, is greater than V. Hence, from | [J7l Def. 5.3], 
{fkjpq} must be algebraically dependent. 

• When C < V: Denote all the C x C submatrices in 

Hall by where D = f . Since Haii is 


rd) 


always row-rank deficient. 


C 


det(Hd) = 0 


(29) 
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for all d G D} and all possible channel states 

{Hg}- From the Leibniz formula, det(H(i) is given by a 
polynomial of the entries in H^. Denote this polynomial 
by gdi{hkjip,q)}) = det(Hd), k G j G 

{p,q) G + 

{{l,...,dk}x{dj + l ,... Then from ([^, gd are 

zero polynomials for all d G {1,..., D}. 

Next, consider the Jacobian matrix of {ftjpq}, i-e.. 
From (|6|, ^^■(j^y-.'^{{fkjpq}) has the 
same structure as Haii, with the following differences: 

In 0, hkj{p,q),pG {4 + 1,..., ivf ^}, 
q G {1,... ,dj} is replaced by 
hkj {p, q) + Hg (p, 4 +1 : Mj)vj (q); 

In ([Tgi, hkj{p,q),p G {1,... ,dk}, 

q G (4 + 1,..., Mj} is replaced by 
hkj {p, q) + Ufe {p)'ii-f 3 (dk +1 : , q). 

Denote all the C xC submatrices in J^Ufc v }i{fkjpq}) 
by {Ji,..., Jd}- Define linear functions ikjpqi'^k^'^j) 
as 


^kjpqi^ k-)'^ j} — 

f hkj {p, q) + {p, dj + 1: Mj)vj (q), 

I if: pG {dk + l,...,Nd^},qG {1,...,4}; 

I hkj (p, q) + (dfc +1 : , q), 

[ if: pG {l,...,4},gG {dj + l,...,Mj}. 

Then from ( |30| ), noticing the one to one correspondence 
between {hkj{p,q)} and {4jpg(Ufe, V^)}, det (Jd) can 
be written as the cascade of gd and {ikjpq}, i-S-, 


det(Jd) =pd({4,p,(Ufc,V,)}), dG (32) 

Since {gd} are zero polynomials, det (J^) = 0, Vd G 
{1,..., D], which means that JjjQ. ({Aip?}) ^1' 


ways row-rank deficient. From |38 
are algebraically dependent. 


Thm. 2.3], {fkjpq} 


Appendix C 
Proof of Theorem 14.31 

From 138 Thm. 2.2], when fkjpq}), is not always row- 
rank deficient, {fkjpq} are algebraically independent. Hence, 
the “if’ side is proved. 

The “only if’ side is true if the following lemma holds: 

Lemma C.l: If {fkjpq} are algebraically independent, 
Jxiifkjpq}) is row-rank deficient on a proper closed subset 
of C^. 

From ( [32l l and ig, the set in which Jx{{ fkjpq}) is row- 
rank deficient is given by where 

Nd = {Ufc, V„ fc G (1,..., if}, j G (1,..., if} : 

5d({4dP,(Ufe,V,)}) = 0} (33) 


If 5 d({ 4 ipg(Ufc, Vj)}) is a zero polynomial of jUfe, Vj}, 
Aid = otherwise. Aid is a proper closed set of C^. 
When {fkjpq} are algebraically independent, at least one 
9d{{^kjpq{fJk, Vj)}) is a non-zero polynomial. Further noting 
that the intersection of closed sets is closed. Lemma |C.1| is 
proved. 


linear coefRcieiits of linear coefficients of 
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Fig. 8. Row-switching and separation of H^ii. For clear illustration, we 
have set A = Aaii when plotting the figure. 


Appendix D 

Proof of Corolfary|+4J 


From Theorem |4.4[ one needs to show that Haii is full row 
rank iff. ( fTSj l is true. As illustrated in Fig. perform row 
switching and then separate Haii into four submatrices, i.e., 
and one zero matrix. The following lemma shows 


the full rankness of H^jj. 


Lemma DA (Full rankness o/HSi{-’ Under condition 3) in 
Corollary 


4.4 


H^jj is full row rank almost surely. 


Proof: Note that 

= diag(H 
G {K 


hSi 


c 

if+D ■ 


,H 


K! 


(34) 


where H^, j G {K + 1,..., K} is aggregated by submatrices 
Vk : (k,j) G A. From the structure of in ( [TOl i, by 
doing row switching operations, can be transformed into 
a block diagonal matrix with dj diagonal blocks. Note that 

(a) the size of these diagonal blocks is {d^^^^l{{k,j) G 

Al}) X (^Mj — dj)', 

(b) within each diagonal block, all entries are independent 
random variables. 

Hence, when condition 3) in Corollary |4.4| holds, the diagonal 
blocks in are full row-rank almost surely. Therefore, 
is full row-rank almost surely. Substituting this result to ( [3^ , 
H^jj is full row-rank almost surely. This completes the proof. □ 
With Lemma |DT] and further noting that Hap is a block- 
upper-triangular matrix, the corollary holds if the following 
proposition is true: 

P ropo sition DA: Under condition 1) and 2) in Corol¬ 
lary 


4.4 




is full row rank iff. is true. 


When ( [T5| | is not satisfied, Hap is row-rank deficient as it 
has more rows than columns. Hence, the “only if’ statement 
in Proposition |D.1| is proved. The “if’ side can be proved via 
the following steps: 

A. Construct one special category of channel state {H^j}. 

B. Show that Hap is full rank almost surely under the special 
category of channel state. 

C. From the first statement in Theorem |4.2[ if Procedure B 
is completed, H^jj is full rank almost surely, and this 
proves the corollary. 

Construct a special Hap by using tools from graph theory. 
Consider a graph Q whose vertexes are the nodes of the 
network and there is an edge between LT j and LR k, if 


{k,j) G A. Then from |32 Thm. 8.15], when the alignment 
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H 


u 


P{k,j) number of 0 


“1” stay on a diagonal 
of the matrix 


diag[d] 


/o • 

• 0 

Is 

0 • 

• !0\ 

0 • 

• 0 

0 

Is^- 

• |0 

1 





1 

V 

0 • 

• 0 

0 

0 • 

• 'is 

' l\ • 

• 0 

0 

0 • 

• 0 

0 • 

• 0 

0 

0 • 

• 0 

lo • 

• 0 

0 

0 • 

■ 0 ) 


R{k,j) number 

> 

of nonzero rows 


Fig. 9. Specify {H^.}. 


set is L-regular, there is a proper L-edge-coloring Page 
138] for the graph. Denote the coloring of an edge between 
LT j and LR k by f{k, j) S {1,2,..., L} and specify } 
as in Fig. in which 

P(fc,j) = d{f {k, j) -1) mod (N-d) (35) 

f d if 

Rik,j) = < (A^-l)modd if/(fc, j) = [fj+1, (36) 

[ 0 otherwise. 

The rest of the proof is similar to that of Cor. 3.3 in pO]. 


Appendix E 

Proof of Corollary I4.5I 


The proof is similar to that of fT^ Cor. 3.4]. To accommo¬ 
date the alignment set A, one need to change equations (24) 
and (25) in to 


‘'kjpq 


^knpq 


1 \f:{k,j)&A 
0 otherwise 


(37) 


k dj 

E E' 

j=l,^k q=l 


kjpq 


<ivf-4, Vfce {l,...,iT}, (38) 


respectively. Then the rest of the proof follows. The details 
are omitted to avoid redundancy. 


Appendix F 

Proof of Theorem I4.5I 

The theorem will be proved by contradiction. 

Suppose there exists a local optimum {U^, V^} such that 


F{{gk,pq{V]l,V])}) > 0. 




{{9k 


4.1 


and 


4.3 




(39) 

jpq})- Hence, from 


jpq}) ~ 

when lA is feasible, the set {{Ufc, Vj} : 


Theorem 

any <5 > 0, there exists a {Ufc,Vj} satisfying; 


{{gkjpq}) is full row rank.} is dense. Therefore, for 


EllUfc-u 


fcllF 


lE-Ei 


’{Ufc.V,} 


{{9k 


JPQ 


E 

3 

}) is full row rank. 


F ^ 


<4 


(40) 


(41) 


Since both F and all gkjpq continuously differentiable, 
J{u^ i/.'^{F) is finite on any bounded close set. Therefore, 
from (|40li, there exists some finite constant C > 0 such that 


F{{9kjpq{iJlV^)}) - F{{gkjpq{iJk,Yj)}) 


< CS^. (42) 


When a matrix A is full row rank, the linear equation set 
Ax = b has solution for any vector b. Therefore, from ( |4T] l, 
there exists {AUfe, AV^j that satisfies linear equation set 



’vecjAUi}' 


3121i(Ui, V 2 ) 

^{Uk,'Vj}{{9kjpq}) 

vecjAUif } 
vecjAVij 

= 

9kjpq{{dk, Vj) 


vec{AV^}. 


PxkdKdf. , V^)_ 


From ( |43| ), 


■ gi2ii(Ui-dAUi,V2-dAV2) ■ 

9Kkd.,,{i^K-SAijK,Vq,-SAV^)_ 

5121i(Ui, V 2 ) 


9KkdK dp, (Uif, ) 

} {{fkjpq}) 


vecjAUi} 


= (1--5) 


_vec{AV/f} 

ffl21l(Ul, V 2 ) 

9KkdKdi,{^ K I k). 


Ag (44) 


Ag, (45) 


where ||Ag|| ~ 0{6^). Denote Ag by 

[A 51211 ,.. •, Agkjpq ,..., ■ 

Further note that F is convex, continuously differentiable 
and F(0,..., 0) = 0. From ( |45] l, there exits some constant 
C > 0 such that 


F{{gkjpq{lJk-SA\Jk,yj-SAVj)}) 

— ^({(1 ~ d)gkjpq{{Jk,'^j) + Agkjpq}) 

< F{{{l-S)gkjpq{iJk,Vj)}) + CS^ 

< SF{0 ,..., 0) + (1 - S)F{{gkjpq{lJk,Yj)}) + CS^ 

= {l-6)Fi{gkjpqiiJk,Vj)}) + C6^. (46) 

From ( |42| ) and ( |46l l, 

F{{gkjpq{t{,VY)})-F{{gk,pq{lJk-SAiJk,yj-SAY,)}) 
= {Fi{gk,pq{iJl,Vj)}) - Fi{gkjpq{iJk,yj)})) + 

[Fi{gk,pq{Vk,Y,)})- 

F{{gkjpq{iJk-6AiJk,Vj-SAV,)})') 

>-CS^ + SF{{gkjpq{iJk, V,)}) - CS^ 

> 5F{{gkjpq{lJl V-L)}) - (C + (7)4 - C4. (47) 

If ( |39] l is true, when 6 is sufficiently small, (HTj) is positive, 
which contradicts the assumption that is a local 

optimum. This completes this proof. 


( 43 ) 
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Appendix G 

Proof of Corollary I4.6I 

Function _F({a;i}) = convex and continuously 

differentiable, with F({0}) = 0. Hence, from Theorem |4.5[ 
one only needs to show that the output of Algorithm [T] i.e., 
}, is a local optimum. 

In Step 2 and 3 of Algorithm the updated U^, and V^, 
given by ( |20| ) and (|2T| are respectively the optimal solutions of 
the following two sets of unconstraint quadratic optimization 
problems; 

Problem G.l (Interference Optimization at LR k): 


minimize 

itk 


E 

j:{j,k)GA 


dh ^ 




(48) 


Problem G.l (Interference Optimization at LT j): 

2 

X di 

^kj 


minimize 

V. 


E 

k-(j,k)&A 




Idj X dj 

V, 


Therefore, Ef=i Ej: 0 -.fc)GA II "fej''j I If is 
increasing in every round of update. Further notin: 
Ef=iE^: 0 -,ic)GAl|UfeHfcjVj||| > 0, Algorithm 0 must 
converge to a local optimum. This completes the proc^ 


lU^H, 


(49) 


non- 

that 
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